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CLAIMS 



What is claimed is: 
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A method for automatically processing a representation 
of a multimedia presentation ha/ing multiple 
information streams contained ^herein, the method 
comprising the steps of: 

(a) matching observed evejft: cues detected within at 
least one information stream of the multimedia 
presentation with af model of expected event cues 
for a class of pi^esentations to which the 
specific multimedia presentation belongs; and 

(b) selecting presentation. segments of the multimedia 
presentation Abased upon the results of matching 
observed evpnt cues with the model of expected 
event cues 



A method as in Claim 1 wherein the step of selecting 
presentation segments is implemented using a finite 
state mach/ne having the expected event cues as state 
transitions , 



2 0 3. A methon as in Claim 1 wherein the expected event cues 
comprise a plurality of time difference based cues. 
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4. A method as in Claim 1 wherein the expected event cues 
comprise a plurality of intrasti^eam cues taken from a 
given information stream. 



A method as in Claim 1 wherein the expected event cues 
comprise interstream cues /taken from more than one 
information stream, and /he step of selecting 
presentation segments comprises correlating the 
interstream event cues 
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A method as in Claim 1 wherein the expected event cues 
are taken from a t/ext information stream. 



7 . A method as in Claim 6 wherein the expected event cues 
are closed captioned word cues. 

8. A method as/in Claim 6 wherein the expected event cues 
are closed/captioned punctuation cues. 

15 9. A method/as in Claim 6 wherein the expected event cues 
are token phrases for the class of multimedia 
presentation. 



10. A mechod as in Claim 9 wherein the token phrases 
comprise text strings. 
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11. A method as in Claim 9 wherein jche token phrases 
comprise closed captioned pundfcuation cues. 

12. A method as in Claim 11 wherein the close captioned 
punctuation cues are selected from the group 
consisting of " >>", ">>>/, and " : n . 
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13 . A method as in Claim 9/ wherein the token phrases 
comprise a named entity and a text string. 

14 . A method as in Cla^n 13 wherein the token phrases 
include "I'm" followed by a <person> named entity. 



10 15. A method as in Claim 9 wherein the token phrases 
comprise a nanyed entity and a closed captioned 
punctuation que. 

16. A method as in Claim 15 wherein the token phrases 
include a/<person> named entity followed by a ":". 

15 17. A method as in Claim 9 wherein the token phrases 
comprise introductory news broadcast terms. 



18. A metfhod as in Claim 17 wherein at least one token 

phrase is selected from the group consisting of "I'm", 
"hello", "welcome", "hello from", "welcome to", 



"thanks for watching", "thanks for joining us", and 
"here on" . / 

A method as in Claim 9 wherein the token phrases 
comprise anchor to reporter hand-off phrases. 

A method as in Claim 19 wherein at least one token 
phrase comprises a/reporter named entity. 

A method as in (Aaim 19 wherein at least one token 
phrase is selected from the group consisting of a 
station identification with a reporter named entity, a. 
reporter named entity with the phrase "joins us", and 
a reporter mamed entity with the phrase "reports". 

A method as in Claim 9 wherein the token phrases 
comprise /reporter to anchor hand-off phrases. 

A method as in Claim 22 wherein at least one token 
phrase/is selected from the group consisting of a 
station identification with a reporter named entity, a 
reporter named entity with a located named entity, 
"baclt to you", and "thank you". 

A method as in Claim 9 wherein the token phrases 
comprise leaders to highlights of upcoming news 
stories . 
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25. A method as in Claim 24 wherpin at least one token 
phrase is selected from the/ group consisting of 
"coming up", "next on", "a^ead on", "when" together 
with a station identification and "returns" , and "also 
ahead" . 



26. A method as in Claim ^wherein the token phrases 
comprise sign off phrases. 
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27. A method as in Cla^n 2 6 wherein at least one token 

phrase is selected^ from the group consisting of "that 
wraps up", "that /is all", "that's all", "that's" 
together with a Aiews program identification, "thanks 
for watching", And "thanks for joining us". 
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28. A method as in Claim 6 wherein the expected event cues 
are. named entities. 



15 29. A method asf in Clam 28 wherein the named entities are 
selected ftrom the group consisting of persons, 
locations/, organizations, times, dates and monetary 
values . 
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A methdti as in Claim 1 wherein the model of expected 
event cues is developed from observed event cues 
occurring in a class of media presentations. 



A method as in Claim 28 wherean the model of expected 
event cues is developed by statistical analysis of 
observed event cues . / 

A method as in Claim 1 wnerein the expected event cues 
are taken from an imag^ information stream. 

A method as in Claim p 2 wherein the expected event 
cues are selected frpm the group consisting of black 
frame, logo frame, Single anchor frame, double anchor 
frame, and reporter frame. 

A method as in Claim 1 wherein the expected event cues 
are taken from an audio information stream. 

A method as in Claim 34 wherein the expected event 
cues are selected from the group consisting of silence 
detection, speaker change detection, and jingle 
detection. / 

A method ak in Claim 1- wherein the expected event cues 
are indications of news stories. 

A methodr as in Claim 34 wherein the expected event 
cues are selected from the group consisting of before 
start <pf broadcast, start of broadcast, highlight 
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segment, advertising, story start, story end, before 
end of broadcast, and end of broadcast. 

A method for automatically processing a representation 
of a multimedia presentation having multiple 
information streams contained therein, the method 
comprising the steps of : / 

(a) selecting at least one contiguous portion of the 
multimedia presentation as a story segment; 

(b) extracting text information from a text 
information stream corresponding to the story 
segment as text data; 

(c) extracting story summary data from the text data; 

(d) extracting nameTd entities from the text data; and 

(e) linking together a stored representation of the 
text data, summary data, and named entity data 
for the story segment . 

A method as in GQ_aim 38 wherein the method 

additionally comprising the steps of: 

(f-) storing ttte representations of the text data, 
summary data, and named entity data for story 
segments/ as one or more files on a file server 
computer connected to a computer network; and 

(g) allowing access to the stored representations of 
news story segments available to a browser 
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program running on at least one client computer 
connected to the computer n^cwork. 

A method for automatically prodessing a representation 
of a multimedia presentation braving multiple 
information streams contained therein, the method 
comprising the steps of: / 

(a) selecting at least oner contiguous portion of the 
multimedia presentation as a story segment; 

(b) extracting text information from a text 
information stream corresponding to the story 
segment as text dajca; 

(c) extracting named entities from the text data; and 

(d) extracting story /summary data using the named 
entities as a basis. 

A method as in Claiin 4 0 wherein the step of extracting 
story summary data/ additionally comprises .the step of: 
(a) determining k frequency of occurrence for the 

named entities per sentence in a story segment; 



and 



(b) selecting /a sentence with a greatest named entity 
frequency of occurrence as a topic sentence. 



A method as Ln Claim 41 wherein step (b) of selecting 
a sentence additionally comprises the step of: 
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(i) if more than one sentence has a greatest 
named entity frequency of occurrence, 
selecting the sentence closest to the 
beginning of the fitory as the topic 
sentence. / 

A method for automatically processing a representation 
of a multimedia presentation having multiple 
information streams canitained therein, the method 
comprising the steps /of : 

(a) selecting at least one contiguous portion of the 
multimedia presentation as a story segment, by 
matching a mcxiel of expected event cues with 
observed evept cues in at least one information 
stream; and/ 

(b) presenting/a summary display of the story segment 
including /one or more named entities extracted 
from a _teKt stream together with a key frame 
extracted from an imagery stream. 

A method fon automatically processing a representation 
of a multimedia presentation having multiple 
information streams contained therein, the method 
comprising/ the steps of: 

(a) selecting at least one contiguous portion of the 
muluimedia presentation as a story segment; and 
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(b) selecting a key frame from An imagery stream 

representative of the segtjfent based upon the type 
of segment . 

A method as in Claim 44 wh^tein the story segment 
contains a reporter segmeryc and the key frame is 
selected from the middle yof the reporter segment . 

A method as in Claim 44/ wherein the story segment 
contains an anchor booyth segment and the key frame is 
selected from the middle of the anchor booth segment. 



A method for presenting a summary representation of a 
multimedia presentation having multiple information 
streams contained /therein, the method comprising the 
steps of: 

(a) automat icaLdy extracting contiguous portions of 
^ the multimedia presentation as story segments; 

and 

(b) presenting a summary display of having multiple 
summary /presentation elements representative of 
the. extracted story segments. 



A method as in Claim 4 7 wherein the summary 
presentation elements from a given story segment are 
displayed/ together. 
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A method as in Claim 4 8 wherein Jche summary 
presentation elements comprise named entities. 

A method as in Claim 48 where/n the summary 
presentation elements comprdyse summary sentences. 

A method as in Claim 48 wherein the summary 
presentation elements comprise a hyperlink to a source 
media element of the segment . 

A method as in Claim y8 wherein step (b) of presenting 
a summary display additionally comprises the step of: 

presenting extracted named entities in a 
hypertext link forty such that hyperlinks lead to 
presentation of additional elements of the story 
segment . / 

A method as in. Gflaim 43 wherein step (b) of presenting 
a summary display additionally comprises the step of: 

in response to a search query for a selected 
named entity, /presenting a thumbnail view comprising 
key frames from multiple story segments containing the 
selected named entity. 

A method ae in Claim 43 wherein step (b) of presenting 
a summary /display additionally comprises the step of: 
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in response to a search /query for a story- 
segments of a selected type/ presenting a thumbnail 
view comprising key frames /from multiple story 
segments of the selected t/ype. 
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55. A method for automatically processing a representation 
of a multimedia presentation having multiple 
information streams contained therein, the method 
comprising the steps pf : 

(a) selecting at legist one contiguous portion of the 
multimedia presentation as a story segment; 

(b) extracting information from at least one 
information stream corresponding to the story 
segment as spurce data; 

(c) extracting k summary representation of the story 
segment frpm the source data; and 

(d) presenting a plurality of related story segments 
using a layered hierarchical presentation of the 
summary /representations at a relatively high 
hierarchical level and the source data at a 
relatively low hierarchical level, together with 
hyperlinks permitting navigation among related 
story segments to a desired hierarchical level of 
representation. 
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56. A methon as in Claim 55 wherein the information stream 
is a text stream, the source data is text relating to 
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a story segment, and thp summary representation 
includes named entitie 

A method as in Claim 55 wherein the information stream 

is an image streamy the source data is image data for 

the complete sto^y segment, and the summary 
representation ifs a key frame. 

A method for automatically processing a representation 
of a multimedia preservation having multiple 
information streams/contained therein, the method 
comprising the steps of: 

(a) selecting yat least one contiguous portion of the 
multimedia pres^n^tion as a story segment; 

(b) extracting name^ entities from a text information 
stream corresponding to the story segment ; and 

(c) used extracted named entities as search criteria 
tcJ select from among a plurality of story 
j/egments. 



A method as in Clainj/58 additionally comprising the 
step of: 

(d) in response/ to a search query, presenting a list 
of named ^entities and their corresponding number 
of occurences in story segments over a selected 
time period. 
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A method as in Claim 58 additionally comprising the 
step of: 

(d) in response to a searjfch query, presenting a graph 
of named entities and their corresponding 
frequency of occurrences in story segments over a 
selected time perioc 

A method as in Claim 60 /additionally comprising the 
step of : 

(e) in response to selection of a point on the graph 
of named entities/ presenting the user with an 
overview story segments containing the selected 
named entity. 

A method as in Claim/ 58 additionally comprising the 
step of: 

(d) in response to/ a search query for a story 
segments of a /selected type, presenting a 
thumbnail view comprising key frames from 
multiple stow segments of the selected type. 



